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Layer-3 Network Routing with RPR Layer-2 Visibility 



BACKGROUND OF THE INVENTION 

1. Field of the Invention. 

5 [0001] This invention relates to communications net- 

works. More particularly, this invention relates to methods and 
systems for improved utilization of communications networks 
configured as layer-2 -ring networks. 

2. Description of the Related Art. 

10 [0002] The meanings of acronyms and certain terminology 

used herein are given in Table 1. 

Table 1 



AS 


Autonomous System 


ATM 


Asynchronous Transfer Mode. A network 
technology based on transferring data in cells 
or packets of a fixed size. 


FEC 


Forwarding equivalence class 


HDLC 


High-level Data Link Control 


IETF 


Internet engineering task force 


IGP 


Interior Gateway Protocol 


IP 


Internet protocol 


LAN 


Local Area Network 


LDP 


Label distribution protocol 


LLC 


Logical link congtrol 


LSA 


Link state advertisement 


LSP 


Label-switched path 


LSR 


Label -switching router 


MAC 


Media access control 


MPLS 


Multi -protocol label switching 


MPLS -TE 


MPLS traffic engineering 


OSI 


Open System Interconnection. A networking 
framework for implementing protocols. 


OSPF 


Open Shortest path First. A routing protocol 


OSPF-TE 


OSPF enhancements used in traffic engineering 
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Rr C 


Request for* comments 


RIP 


Routing information protocol 


RPR 


Resilient packet rings -- a protocol 


RSVP 


Resource reservation protocol 


RSVP-TE 


An extension of RSVP, used in traffic 
engineering 


SRP 


Spatial reuse protocol 


TE 


Traffic engineering 


TLV 


Type-Length-Value . An encoding scheme 



[0003] Local Area Networks (LAN's) connect computing 

systems together. LAN's of all types can be connected together 
using Media Access Control (MAC) bridges, as set forth in the 
5 "IEEE Standard for Information Technology, Telecommunications 
and Information Exchange between Systems, Local and Metropoli- 
tan Area Networks, Common Specifications, Part 3: Media Access 
Control (MAC) Bridges," published as ANSI/IEEE Standard 802. ID 
(1998). The 802. ID standard is available via the Internet at 

10 the URL standards . ieee . org/catalog/lEEE802 . 1 . html . 

[0004] Data networks, including LAN's, are commonly 

conceptualized as a hierarchy of layers according to the Open 
System Interconnection Model (OSI) . OSI defines a networking 
framework for implementing protocols in seven layers, of which 

15 layer-3 (network layer) , and layer-2 (data link layer) are 
relevant to the instant invention. 

[0005] Implementation of layer-3 requires high level 

knowledge of the network organization, and access to router ta- 
bles that indicate where to forward or send data. This layer 

20 provides high level switching and routing technologies, and 
creates logical paths, known as virtual circuits, for transmit- 
ting data from node to node. In layer-3, data is transmitted by 
creating a frame that usually contains source and destination 
network addresses . 
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[0006] Layer-2 encapsulates the layer-3 frame, adding 

more detailed data link control information to form a new, lar- 
ger frame. Layer-2 implements a transmission protocol and han- 
dles flow control, frame synchronization, and handles errors 
5 arising in the physical layer (layer-1) . Layer-2 is divided 
into two sublayers: a media access control (MAC) sublayer and a 
logical link control (LLC) sublayer. The MAC sublayer controls 
how a computer on the network gains access to the data and its 
permission to transmit the data. The LLC layer controls frame 

10 synchronization, flow control and error checking. 

[0007] HDLC (High-level Data Link Control) is a related 

term that refers to a group of layer-2 protocols or rules for 
transmitting data between network points, known as nodes. In 
HDLC, data is organized into frames and sent across a network 

15 to a destination that verifies its successful arrival. The HDLC 
protocol also manages the flow or pacing at which data is sent. 

[0008] The Open Shortest Path First (OSPF) protocol is 

a link-state layer-3 routing protocol used for Internet rout- 
ing. OSPF is described in detail by Moy in OSPF Version 2, pub- 

20 lished as Request for Comments (RFC) 2328 of the Internet Engi- 
neering Task Force (IETF) Network Working Group (April, 1998), 
which is incorporated herein by reference. This document is 
available at www.ietf.org, as are the other IETF RFC and draft 
documents mentioned below. OSPF is used by a group of Internet 

2 5 Protocol (IP) routers in an Autonomous System (AS) to exchange 

information regarding the system topology. The term "Autonomous 
System" denotes a group of routers exchanging routing informa- 
tion via a common routing protocol. Each OSPF router maintains 
an identical topology database, with exceptions as noted below. 

3 0 Based on this database, the routers calculate their routing ta- 
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bles by constructing a shortest -path tree to each of the other 
routers . 

[0009] Each individual piece of the topology database 

maintained by the OSPF routers describes the "local state" of a 
5 particular router in the Autonomous System. This local state 
includes information such as the router's usable interfaces and 
reachable neighbors. The routers distribute their local state 
information by transmitting a link state advertisement (LSA) . 
Packets containing link state advertisements are flooded 
10 throughout the routing domain. The other routers receive these 
packets and use the LSA information to build and update their 
databases . 

[0010] OSPF allows collections of contiguous networks 

and hosts to be grouped together to form an OSPF area. An OSPF 
15 area includes routers having interfaces to any one of the 
grouped networks. Each area runs a separate copy of the basic 
link-state routing algorithm. The topology of an OSPF area is 
invisible from outside of the area. Conversely, routers inter- 
nal to a given area does not know the detailed topology exter- 

2 0 nal to the area. This isolation of knowledge results in a 

marked reduction in routing traffic, as compared to treating 
the entire Autonomous System as a single link-state domain. A 
router in an Autonomous System has a separate topological data- 
base for each area to which it is connected. Routers connected 
25 to multiple areas are called area border routers. However, 
routers belonging to the same area have, for that area, identi- 
cal area topological databases . 

[0011] An OSPF LSA database allows a layer-3 aware net- 

work element, such as a router, to build its routing table by 

3 0 running the well-known SPF algorithm. The element then routes 
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IP packets based on the actual routing table and on the desti- 
nation IP address in the IP packet header. A cost is associated 
with the output side of each router interface, and is used by 
the router in choosing the least costly path for the packets. 
5 This cost is configurable by the system administrator. The 
lower the cost, the more likely the interface is to be used to 
forward data traffic. For the purposes of cost calculation and 
routing, OSPF recognizes two types of networks (which may be 
organized as IP networks, subnets or supernets) : point-to-point 

10 networks, which connect a single pair of routers; and multi- 
access networks, supporting two or more attached routers. Each 
pair of routers on a multi-access network is assumed to be able 
to intercommunicate directly. An Ethernet is an example of a 
multi-access network. Each multi -access network includes a 

15 "designated router," which is responsible for flooding LSA's 
over the network, as well as certain other protocol functions. 
Further details concerning network cost calculation and routing 
are disclosed in Application No. 10/211,066, (Publication 
No. 20030103449), which is commonly assigned herewith, and 

2 0 herein incorporated by reference. 

[0012] Multi-access layer-2 networks may be configured 

internally as rings. The leading bi-directional protocol for 
layer-2 high-speed packet rings is the Resilient Packet Rings 
(RPR) protocol, which is in the process of being defined as 
25 IEEE standard 802.17. Network -layer -routing over RPR is de- 
scribed, for example, by Jogalekar et al . , in IP over Resilient 
Packet Rings (Internet Draft draft -j ogalekar- iporpr- 00 ) , and by 
Herrera et al . , in A Framework for IP over Packet Transport 
Rings (Internet Draft draf t-ietf -ipoptr-f ramework-00 ) . A pro- 

3 0 posed solution for media access control (MAC protocol layer-2) 
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in bi-directional ring networks is the Spatial Reuse Protocol 
(SRP) , which is described by Tsiang et al . , in the IETF docu- 
ment RFC-2892, entitled The Cisco SRP MAC Layer Protocol. Using 
protocols such as these, each node in a ring network can commu- 
5 nicate directly with all other nodes through either an inner or 
an outer ring, using the appropriate Media Access Control (MAC) 
addresses of the nodes. The terms "inner" and "outer" are used 
arbitrarily herein to distinguish the different ring traffic 
directions. These terms have no physical meaning with respect 

10 to the actual configuration of the network. 

[0013] Multiprotocol Label Switching (MPLS) is gaining 

popularity as a method for efficient transportation of data 
packets over connectionless networks, such as Internet Protocol 
(IP) networks. MPLS is described in detail by Rosen et al . , in 

15 Request for Comments (RFC) 3 031 of the Internet Engineering 
Task Force (IETF) , entitled "Multiprotocol Label Switching Ar- 
chitecture" • (January, 2001) . In conventional IP routing, each 
router along the path of a packet sent through the network ana- 
lyzes the packet header and independently chooses the next hop 

2 0 for the packet by running a routing algorithm. In MPLS, how- 
ever, each packet is assigned to a Forwarding Equivalence Class 
(FEC) when it enters the network, depending on its destination 
address. The packet receives a short, fixed- length label iden- 
tifying the FEC to which it belongs. All packets in a given FEC 

2 5 are passed through the network over the same path by label - 
switching routers (LSR's). Unlike IP routers, LSR' s simply use 
the packet label as an index to a look-up table, which speci- 
fies the next hop on the path for each FEC and the label that 
the LSR should attach to the packet for the next hop. 
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[0014] Since the flow of packets along a • label -switched 

path (LSP) under MPLS is completely specified by the label ap- 
plied at the ingress node of the path, a LSP can be treated as 
a tunnel through the network. Such tunnels are particularly 
5 useful in network traffic engineering, as well as communication 
security. MPLS tunnels are established by "binding" a particu- 
lar label, which is assigned at the ingress node to the net- 
work, to a particular FEC . 

[0015] Currently, layer-3 routing protocols, such as 

10 RIP and OSPF, are unaware of the topology of layer-2 RPR net- 
works with which they must interact. A routing table allows the 
router to forward packets from source to destination via the 
most suitable path, i.e., lowest cost, minimum number of hops. 
The routing table is updated via the routing protocol, which 

15 dynamically discovers currently available paths. The routing 
table may also be updated via static routes, or can be built 
using a local interface configuration, which is updated by the 
network administrator. However, the RPR ingress and egress 
nodes chosen in the operation of automatic routing protocols do 

2 0 not take into account the internal links within the RPR ring, 
and may therefore cause load imbalances within the RPR subnet, 
which generally results in suboptimum performance of the larger 
network. 

SUMMARY OF THE INVENTION 

25 [0016] According to a disclosed embodiment of the in- 

vention, methods and systems are provided for the manipulation 
of layer-3 network nodes, external routers, routing tables and 
elements of layer-2 ring networks, such as RPR networks, ena- 
bling the layer-3 elements to view the topology of a layer-2 
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ring subnet. This feature permits routers to choose optimal en- 
try points to the layer-2 subnet for different routes that pass 
into or through the layer-2 subnet. This enables virtual tun- 
nels or routing paths to utilize all existing entry links to 
5 the subnet and to minimize cost factors, such as the number of 
spans required to traverse the subnet from the entry point to a 
destination node of the subnet. 

[0017] In an aspect of the invention, the routing ta- 

bles of RPR subnet elements are manipulated such that traffic 

10 routes originating in or passing through different elements of 
the RPR subnet and destined for network locations outside the 
RPR ring have individualized exit nodes. The exit points for 
the different routes are chosen to minimize cost factors, such 
as the number of spans required to reach the exit node from 

15 each node of the layer-2 subnet. 

[0018] The invention provides a method for obtaining 

ingress to a layer-2 ring network to reach nodes thereof, the 
nodes including ingress nodes that couple the ring network to 
an external layer-3 network, which is carried out in the in- 

2 0 gress nodes by creating entries in a host table, each of the 

entries including an address of a respective one of the nodes 
of the ring network and a metric that is determined respon- 
sively to a topology of the ring network. Thereafter, the 
method is further carried out by uploading the host table to 
25 external elements of the layer-3 network, defining paths from 
the external elements to designated ones of the nodes of the 
ring network by selecting one of the ingress nodes for each of 
the paths responsively to the metric, and transmitting- data 
from network elements that are external to the ring network to 

3 0 at least one of the nodes via a selected one of the paths. 
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[0019] According to an aspect of the method, the ring 

network is a RPR subnet. 

[0020] According to an additional aspect of the method, 

the ingress nodes are selected responsively to a minimum value 
5 of the metric. 

[0021] According to another aspect of the method, the 

ingress nodes are selected responsively to a maximum value of 
the metric. 

[0022] In an additional aspect of the method, paths are 

10 defined in one or more of the external elements. The paths may 
be virtual tunnels. 

[0023] In one aspect of the method, the layer-3 ~ network 

is an IP network, and uploading is achieved by flooding router 
LSA's with a mask, which can be a 32-bit mask. 
15 [0024] In another aspect of the method stub networks 

are flooded to achieve uploading. 

[0025] One aspect of the method uploading is performed 

by external LSA advertising to the layer- 3 network. 

[0026] According to another aspect of the method, the 

2 0 metric includes a cost factor that is computed between one of 
the ingress nodes and the respective one of the nodes. 

[0027] According to yet another aspect of the method, 

the cost factor varies with a number of layer-2 spans between 
the one ingress node and the respective one of the nodes. 
25 [0028] In another aspect of the method paths are de- 

fined by computing a total cost based on the cost factor and on 
interface costs that are assigned in the layer- 3 network, and 
selecting the paths so as to minimize the total cost. 
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[0029] According to a further aspect of the method, the 

metric is determined responsively to a number of hops between 
the ingress nodes and the respective one of the nodes. 

[0030] According to another aspect of the method, the 

5 ingress nodes are configured with an interface cost on the 
layer-3 network, and the metric is determined proportionally to 
the interface cost and to the number of hops . 

[0031] According to a further aspect of the method, the 

ingress nodes are configured with an interface cost on the 
10 layer-3 network, and the metric is determined by the interface 
cost divided by the number of hops . 

[0032] The invention provides a computer software prod- 

uct, including a computer-readable medium in which computer 
program instructions are stored, which instructions, when read 
15 by a computer, cause the computer to perform a method for ob- 
taining ingress from an external layer-3 network to a layer-2 
ring network to reach nodes thereof, which is carried out by 
configuring ingress nodes of the ring network to create entries 
in a host table, each of the entries including an address of a 
20 respective one of the nodes of the ring network and a metric. 
The method is further carried out by configuring the ingress 
nodes to thereafter upload the host table to external elements 
of a data network that interfaces with the ring network via the 
ingress nodes, configuring the external elements to define 

2 5 paths from the external elements to designated ones of the 

nodes of the ring network, each of the paths leading through a 
selected one of the ingress nodes responsively to the metric, 
and transmitting data from network elements that are external 
to the ring network to at least one of the nodes via a selected 

3 0 one of the paths. 
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[003 3] The invention provides a network routing system 

for obtaining ingress from an external layer- 3 network to a 
layer-2 ring network to reach nodes thereof, including first 
routers disposed in ingress nodes of the ring network. The 
5 first routers are adapted for creating entries in a host table, 
each of the entries including an address of a respective one of 
the nodes of the ring network and a metric. The first routers 
are further adapted for uploading the host table to external 
elements of a data network that interfaces with the ring net- 

10 work via the ingress nodes. A second router is disposed in at 
least one of the external elements. The second router is 
adapted for defining paths from the external elements to desig- 
nated ones of the nodes of the ring network, each of the paths 
leading through a selected one of the ingress nodes respon- 

15 sively to the metric, and transmitting data from network ele- 
ments that are external to the ring network to at least one of 
the nodes via a selected one of the paths. 

[0034] The invention provides a method for obtaining 

egress from a layer-2 ring network to an external layer-3 net- 

2 0 work, which is carried out in nodes of the ring network by cre- 
ating entries in a host table, each of the entries including an 
address of a respective one of the nodes of the ring network, 
and a metric determined responsively to a topology of the ring 
network. The method is further carried out by defining paths 

2 5 from the nodes through egress nodes of the ring network to ex- 

ternal elements in the external layer-3 network, selecting one 
of the paths responsively to the metric, and transmitting data 
from at least one of the nodes via the selected one of the 
paths to network elements that are external to the ring net- 

3 0 work. 
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[0035] 



The invention provides a computer software prod- 



uct, including a computer-readable medium in which computer 
program instructions are stored, which instructions, when read 
by a computer, cause the computer to perform a method for ob- 
5 taining egress from a layer-2 ring network to an external 
layer- 3 network, which is carried out in nodes of the ring net- 
work by creating entries in a host table, each of the entries 
including an address of a respective one of the nodes of the 
ring network and a metric. The method is further carried out by 
10 defining paths from the nodes through egress nodes of the ring 
network, selecting one of the paths responsively to the metric, 
and transmitting data from the nodes via the selected paths to 
network elements that are external to the ring network. 



15 for obtaining egress from a layer-2 ring network to an external 
layer-3 network, including a plurality of routers disposed in 
nodes of the ring network. The routers are adapted for creating 
entries in a host table, each of the entries including an ad- 
dress of a respective one of the nodes of the ring network and 

2 0 a metric. The routers are further adapted for defining paths 
from the nodes through egress nodes of the ring network, for 
selecting one of the paths responsively to the metric, and for 
transmitting data from the nodes via the selected paths to net- 
work elements that are external to the ring network. 

2 5 [0037] The invention provides a method for routing data 

through a layer-2 ring network, the ring network having inter- 
face nodes with external network elements of a data network and 
non- interface nodes, which is carried out in the interface 
nodes of the ring network by creating first entries in a first 

3 0 host table, each of the first entries including an address of a 



[0036] 



The invention provides a network routing system 
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respective one of the non- interface nodes and a first metric. 
The method is further carried out by thereafter uploading the 
first host table to the external network elements, and using 
the first host table to identify optimum ingress paths from the 
5 external network elements to the non- interface nodes, each of 
the ingress paths leading through one of the interface nodes 
responsively to the first metric. The method is further carried 
out in the non- interface nodes of the ring network by creating 
second entries in a second host table, each of the second en- 

10 tries including an address of a respective one of the interface 
nodes and a second metric, using the second host table to iden- 
tify optimum egress paths from the non- interface nodes through 
different ones of the interface nodes of the ring network re- 
sponsively to the second metric, and transmitting data to and 

15 from the ring network via the ingress paths and the egress 
paths . 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0038] For a better understanding of the present inven- 

tion, reference is made to the detailed description of the in- 
2 0 vent ion, by way of example, which is to be read in conjunction 
with the following drawings, wherein like elements are given 
like reference numerals, and wherein: 

[0039] Fig. 1 is a schematic diagram illustrating a 

portion of a data network, which is operative in accordance 
25 with a disclosed embodiment of the invention; 

[0040] Fig. 2 is a flow diagram illustrating a method 

of obtaining ingress to a layer-2 subnet from a layer- 3 network 
at different entry points in accordance with a disclosed em- 
bodiment of the invention; and 
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[0041] Fig. 3 is a flow diagram illustrating a method 

of obtaining egress from a layer-2 subnet into a layer-3 net- 
work at different exit points in accordance with a disclosed 
embodiment of the invention. 

5 DETAILED DESCRIPTION OF THE INVENTION 

[0042] In the following description, numerous specific 

details are set forth in order to provide a thorough under- 
standing of the present invention. It will be apparent to one 
skilled in the art, however, that the present invention may be 

10 practiced without these specific details. In other instances 
well-known circuits, control logic, and the details of computer 
program instructions for conventional algorithms and processes 
have not been shown in detail in order not to unnecessarily ob- 
scure the present .invention. 

15 [0043] Software programming code, which embodies as- 

pects of the present invention, is typically maintained in per- 
manent storage, such as a computer readable medium. In a cli- 
ent-server environment, such software programming code may be 
stored on a client or a server. The software programming code 

2 0 may be embodied on any of a variety of known media for use with 
a data processing system. This includes, but is not limited to, 
magnetic and optical storage devices such as disk drives, mag- 
netic tape, compact discs (CD's), digital video discs (DVD's), 
and computer instruction signals embodied in a transmission me- 

2 5 dium with or without a carrier wave upon which the signals are 
modulated. For example, the transmission medium may include a 
communications network, such as the Internet. In addition, 
while the invention may be embodied in computer software, the 
functions necessary to implement the invention may alterna- 
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tively be embodied in part or in whole using hardware compo- 
nents such as application-specific integrated circuits or other 
hardware, or some combination of hardware components and soft- 
ware . 

5 Overview. 

[0044] Turning now to the drawings, reference is ini- 

tially made to Fig. 1, which is a schematic diagram illustrat- 
ing a portion of a data network 10, which is operative in ac- 
cordance with a disclosed embodiment of the invention. The data 

10 network 10 has a RPR subnet 12 formed of RPR nodes 14, 16, 18, 
20, 22. The RPR nodes 14, 16, 22 are interface nodes, interfac- 
ing with an external layer-3 network 24, which is typically an 
IP-aware network, and which may also have MPLS functions. The 
RPR nodes 18, 20 are non- interface nodes. Although five RPR 

15 nodes are shown representatively in Fig. 1, the invention can 
be practiced with other layer-2 subnets comprising any number 
of nodes. The data network 10 also has an external IP/MPLS 
node 26. The exemplary network 24 (30.30.30.0/24) is applicable 
to a method of choosing the exit point form each RPR network 

20 element, as is disclosed in further detail hereinbelow. 

[0 045] Routers in the network 10, such as a router at 

the IP/MPLS node 26, build routing tables, each containing 
routing entries for specific destination networks and the 
specification of a hop to the next router along the path to the 

2 5 destination network. Table 2 is an example of such an entry. 
The destination in Table 2 is shown as a network address. This 
means that all IP packets to all hosts (in this case the RPR 
nodes 14, 16, 18, 20, 22) within the RPR subnet 12 (10.10.10.0) 
flow through the same path. 
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Table 2 



Destination 
network 


Destination mask 


Next hop IP 


Cost to 
destination 


10 . 10 . 10 . 0 


255.255.255.0 


10 . 10 . 12 . 1 


120 



[0046] There are signaling protocols known in the art, 

such as RSPV-TE or LDP, which use the routing table to create 
5 virtual tunnels in the data network 10 with pre-defined re- 
served bandwidth along the routing path. These tunnels might be 
provisioned to use dynamic routes, as specified by the routing 
protocol, i.e., routes that are configured automatically (i.e., 
dynamically path-routed according to the IGP route) by the 

10 routers based on factors such as cost parameters assigned to 
different links. Protocols for route discovery are known as 
interior gateway protocols (IGP), such as OSPF, RIP, IS-IS. 
When different routes to the same destination have the same 
cost, the routers choose one of the routes arbitrarily, accord- 

15 ing to some predefined criterion. In a multi -access subnet, 
such as the RPR subnet 12 shown in Fig. 1, all nodes are con- 
figured to have the same cost (20) . Therefore, the IP/MPLS 
node 2 6 would configure its routing database to point to the 
RPR subnet 12 (the destination network 10.10.10.0/24) via a 

2 0 single computed minimum cost next hop. Consequently, all sig- 
naled label -switched paths would always flow into the RPR sub- 
net 12 via one, and only one, ring entry point. 

[0047] As mentioned above, layer-3 protocols, such as 

OSPF are unaware of the layer-2 RPR ring topology with multiple 

2 5 segments between two adjacent nodes. OSPF update dynamically 
updates the routing table of external routers, such as the 
IP/MPLS node 26, so as to route packets to the RPR subnet 12 
via a single entry point based on minimum cost. In Fig. 1 the 
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available entry points, RPR nodes 14, 16, 22, have identical 
costs of 100. The RPR node 14 (10.10.12.1) could be chosen as 
the entry point to the RPR subnet 12 arbitrarily. OSPF builds a 
topology database at the IP/MPLS node 26, and constructs an en- 
5 try in the routing table, specifying routing to the RPR sub- 
net 12 (10.10.10.0/24) via a next hop through the RPR node 14 
(10.10.12.1) with a cost 120 (100 + 20). In this case since the 
IGP route specifies that all IP packets designated to the RPR 
subnet should flow through the address 10.10.12.1, any IP RSVP- 

10 TE path message packet that is configured to use a dynamic 
route will flow through this interface. Thus, all signaled LSP, 
i.e., MPLS tunnels, extending from the IP/MPLS node 26 (NEa) or 
other network elements within the MPLS "cloud" , to the RPR 
nodes 14, 16, 18, 20, 22 (NEb, NEc, NEd, NEe and NEf) will flow 

15 through one link 28, identified as subnet 10.10.12.0/24. 

[0048] There are two important disadvantages of this 

convent ional behavior : 

[0049] First, all the tunnels utilize only one RPR en- 

try link. The other two possible links via the RPR nodes 16, 22 

2 0 remain unused. 

[0050] Second, the tunnels are configured on RPR spans 

without minimum hop ring entry awareness. For example, if a 
tunnel were to be established so as to reach the RPR node 20, 
it would have been preferred that the tunnel be configured dy- 

2 5 namically via the RPR node 22 as an entry point, instead of the 

RPR node 14. Configuring the tunnel via the RPR node 22 would 
result in minimum RPR span utilization. This is apparent from 
the topology of the RPR subnet 12, wherein two RPR spans are 
required to reach the RPR node 20 from the RPR node 14, a first 

3 0 span connecting the RPR node 14 to the RPR node 22, and a sec- 
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ond span connecting the RPR node 22 to the RPR node 20. Only 
one RPR span is required to reach the RPR node 2 0 from the RPR 
node 22. OSPF is not aware of the topology of the RPR sub- 
net 12, and simply sees it as one layer-2 network. OSPF in con- 
5 ventional operation is thus unable to optimally route IP pack- 
ets to each RPR network element with the number of RPR spans 
minimized, and therefore cannot configure a signaled MPLS tun- 
nel via the shortest path through the layer-2 structure. In 
this sense, OSPF has no layer-2 visibility. 

10 [0051] Considering outbound traffic from the RPR sub- 

net 12 to external routers and networks, such as the net- 
work 24, the same exit point for a particular destination net- 
work is utilized in conventional operation, regardless of the 
originating node of the RPR subnet 12. This is due to the fact 

15 that when OSPF constructs its internal database, three alterna- 
tives for the exit point, the RPR nodes 14, 16, 22, are consid- 
ered. Assuming that the cost from each exit point (i.e., the 
RPR nodes 14, 16, 22) to the destination network 24 
(30.30.30.0/24) is equal, each of the elements of the RPR sub- 

2 0 net 12 will construct its routing table so that the same exit 
point is always chosen to that destination, without considering 
the number of RPR spans utilized to reach the chosen exit 
point, for example, the RPR nodes 16, 18, 2 0 will all have the 
following entry in their routing tables: 10.10.10.10, as shown 

25 in Table 3 . 



Table 3 



Destination 
network 


Destination 
mask 


Next hop I P 


Cost to 
destination 


30.30.30.0 


255 . 255 .255 . 0 


10.10.10. 10 


120 + Y 
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[0052] In Table 3, the cost factor in the routing table 

entry from the RPR subnet 12 to the network 24 (30.30.30.0) 
is 120 + Y, where Y is the cost to the destination in the 
IP/MPLS network beyond the IP/MPLS node 26 (NEa) . 
5 [0053] In one aspect of the invention, the inventors 

have discovered how to overcome the above-mentioned disadvan- 
tages by manipulating the costs associated with different RPR 
nodes, so as to cause the routing tables of external layer- 3 
network elements, such as the IP/MPLS node 26 and other exter- 

10 nal routers (not shown) , to point to different RPR- IP host ad- 
dress in the RPR subnet 12 via different entry points into the 
RPR ring. This technique can be used to cause virtual tunnels 
to be created dynamically, and other routing paths to utilize 
all existing entry links to the RPR subnet 12. The costs are 

15 typically manipulated using a metric that favors signaled LSP 
tunnels and other paths that cover the minimum number of hops 
(or least incur minimum cost) from the entry point to the de- 
sired RPR node. 

[0054] In another aspect of the invention, the same 

2 0 cost manipulation causes the host routing tables of the RPR 
nodes 14, 16, 18, 20, 22 in the RPR subnet 12 to select differ- 
ent respective RPR ring exit nodes for outbound IP traffic in- 
tended for the same destination network. The exit point that is 
selected for the RPR nodes 14, 16, 18, 20, 22 is based on mini- 
25 mum cost, taking into consideration the number of RPR spans re- 
quired to reach the exit node. 

[0055] In the detailed examples given below, the metric 

is defined in such a way that the route selected is the one 
with the lowest metric score. Alternatively, many different 
30 metrics can be defined. For example, the metric may be defined 
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so that the dynamic selection of ingress and exit points could 
be responsive to a maximum value of the metric. 

Ingress Routing. 

[0056] Reference is now made to Fig. 2, which is a flow 

5 diagram illustrating a method of obtaining ingress to a layer-2 
subnet having a ring topology from a layer-3 network at differ- 
ent entry points in accordance with a disclosed embodiment of 
the invention. The subnet is a RPR subnet in the current em- 
bodiment, but could be other types of subnets having a ring to- 

10 pology. The method relies on addition of each RPR node's RPR-1P 
address (or alternatively, the node's IP loopback address) to 
the node's OSPF host table as defined by OSPF Version 2, Appen- 
dix C.7, and assigning a manipulated cost that is relative to 
the number of layer-2 RPR spans. The loopback address is a vir- 

15 tual IP address assigned to the RPR node, as distinguished from 
the RPR-IP address, which is assigned to the RPR interface. In 
some embodiments, signaling could be directed to the RPR-IP or 
the loopback IP address. Furthermore, the assigned relative 
cost is derived from the RPR reference topology, as defined in 

2 0 the above -noted IEEE standard 802.17. That is, each RPR node 
has a constructed RPR reference topology that specifies all 
other ring nodes, and their relative position within the RPR 
ring, i.e., the number of spans. The cost factor is based on 
the number of RPR spans between the RPR node and the entry 

25 point to the ring. The process steps that follow are shown with 
reference to a single RPR node. However, all RPR nodes in the 
ring that have at least one external MPLS link normally execute 
the process steps shown below independently and concurrently. 

[0057] At initial step 30, a RPR node of a RPR subnet 

30 examines its configuration with respect to the subnet topology. 
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[0058] Control passes immediately to decision step 32, 

where the current node, chosen in initial step 30, determines 
if it has at least one IP external interface (e.g., the inter- 
face 10.10.12.1/24 of the RPR node 14 (Fig. 1)). 
5 [0059] If the determination at decision step 32 is 

negative, then control proceeds to final step 34, which is de- 
scribed below. 

[0060] If the determination at decision step 32 is af- 

firmative, then at step 3 6 the current node updates its host 

10 routing table (OSPF Version 2, Appendix C.7) with all other 
mate RPR- IP nodes in the ring based on the RPR reference topol- 
ogy. This table indicates what hosts are directly attached to a 
router, and what metrics and types of service should be adver- 
tised for them. In embodiments employing OSPF Version 2, de- 

15 tails of the host routing table are given in Appendix C.7 
(RFC 2328) of the above-noted OSPF specification. All RPR host 
addresses that are specified in the RPR reference topology are 
added to the host routing table. The reference topology is up- 
dated with all IP RPR addresses within the RPR ring. For exam- 

2 0 pie, in Fig. 1, the RPR node 14 (NEb) has its RPR reference to- 

pology updated with IP addresses 10.10.10.10, 10.10.10.11, 
10.10.10.12, 10.10.10.13, 10.10.10.14. Once updated in the OSPF 
host table, each host IP address (except for IP address of the 
RPR node 14) is advertised, as a 3 2 -bit mask. 
25 [0061] Next, at step 38, each entry of the OSPF host 

table is updated to indicate the OSPF area to which the RPR 
node belongs . 

[0062] Next, at step 40, each entry added in step 36 is 

specified by a cost metric. In one embodiment, the metric is 

3 0 based on the following formula 
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COSTm = Kl*#OJHopsToNode'sIpAdd + K2 . ( 1 ) 

Kl and K2 may be calculated as 

CostConfiguredOnRprlpInterafce 

Al = , ( 2 ) 

# OfNodesIn Re ferenceTopo log y 

and X*2 = l. Alternatively, other values of Kl, K2 may be calcu- 
lated, wherein in Equation 1 and Equation 2 : 

[0063] CostConf iguredOnRprlpInterf ace is 

the actual cost configured by the operator on 
the IP interface of the RPR. For example, in 
each of the RPR nodes shown in Fig. 1, the cost 
is 20 . 

[0064] #of Nodes InRe ferenceTopology is 

the number of nodes in the RPR ring, as listed 
in the node's reference topology. For example, 
the number of nodes in the RPR subnet 12 
(Fig. 1) is five. 

[0065] #Of HopsToNode ' sIpAdd is the num- 

ber of RPR spans from the current node to the 
given destination node for the present entry, as 
indicated in the RPR reference topology via the 
shortest route (i.e., outer or inner ringlet di- 
rection) . For example, in Fig. 1, if the current 
node is the RPR node 14, and the destination 
node for this entry is the RPR node 18 (IP ad- 
dress 10.10.10.12 in the OSPF host table), then 
#Of HopsToNode' sIpAdd = 2. 

[0066] The operator u *" represents mul- 

tiplication. 
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[0067] Equation 1 and Equation 2 are representative of 

a formula for calculating a cost factor. Many alternative met- 
rics and formulas can be applied in step 40. 

[0068] Next, at step 42 entries in the OSPF host table 

5 are flooded in the current OSPF area using router LSA packets. 
This step updates all external routers as well as all RPR nodes 
with the new entries. This step will cause the OSPF database to 
be synchronized in all participating OSPF areas. 

[0069] At step 44 all external routers, such as the 

10 IP/MPLS node 2 6 (Fig. 1) are informed by the router LSA packets 
that were transmitted in step 42 that there is a new route to 
the advertised hosts in the RPR subnet. 

[0070] Alternatively, advertising may be achieved using 

external LSA advertising as specified in OSPF Version 2, Sec- 
15 tion 12, Link State Advertisements. In this advertising method, 
each RPR node is added to the external LSA database with a 32- 
bit mask. Cost is calculated is described above, using Equa- 
tion 1. Furthermore, although the embodiments described herein 
make use of OSPF, the methods of the present invention may 
2 0 similarly be adapted for use with other routing and control 
protocols . 

[0071] In either case, external routers now evaluate 

alternate paths to the nodes of a RPR subnet, based on the OSPF 
database updates that they received at step 42 . Referring again 
25 to the example of Fig. 1, the IP/MPLS node 26 now sees four 
possible new paths to the RPR node 2 0 (RPR IP ad- 
dress 10.10.10.13/24): 

[0072] 1. Via the RPR node 14 (10.10.12.0) 

with cost, calculated using Equation 1 as 100 + COSTm 
30 (of the RPR node 14) : 100 + COSTm = 100 + 9 = 109; 
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[0073] 2. Via the RPR node 22 (10.10.13.0) 

with cost of 100 + COSTm = 100 + 5 = 105; 

[0074] 3. Via the RPR node 16 (10.10.11.0) 

with cost of 100 + COSTm = 100 + 9 = 109; and 

5 [0075] 4. Via the link 28 and the RPR node 14 

(10.10.12.0) with cost 100 + 20 = 120 (this is a 

r 

route to network 10.10.10.0) 
[0076] Control now proceeds to final step 34, where a 

route to the RPR node is chosen. Typically, the external router 

10 will choose the path with a lowest cost. In the embodiment 
shown in Fig. 1, the selected path has the minimum number of 
hops. In still other embodiments, the cost factor is used to 
arbitrate among different paths all having the minimum number 
of hops. In the example of Fig. 1, in the current embodiment, 

15 the route chosen is via the RPR node 22 (10.10.13.0). This 
path, as seen in the example of Fig. 1, consumes the minimum 
number of layer-2 hops within the RPR ring. 

Egress Routing* 

[0077] The OSPF standard allows multiple equal-cost 

20 paths to exist to a destination, having different next hop ad- 
dresses. Referring again to the example of Fig. 1, the RPR 
node 18 (NEd) has three different exit points from the RPR sub- 
net 12, the RPR nodes 14, 16, 22. Each exit point is repre- 
sented by a different next hop IP address entry in the OSPF 
25 routing table. Conventionally, the RPR node 18 would see each 
exit point as having the same cost 2 0 (the cost of the RPR in- 
terface) . According to an embodiment of the present invention, 
however, the cost to each exit point is adjusted based on the 
number of RPR spans from the RPR node 18 to each exit point, in 
3 0 a manner similar to that described above with reference to 
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Fig. 2. This results in different paths leading to the layer-3 
network 24 having non-equal costs, depending on the different 
numbers of layer-2 RPR spans needed to exit from the RPR sub- 
net 12 on each path. Typically, each node selects the path hav- 
5 ing the minimum total cost. As in ingress routing, the egress 
routing is disclosed with respect to a RPR subnet. However, the 
principles of this aspect of the invention are applicable to 
layer-2 subnets having ring topologies other than RPR subnets. 

[0078] Reference is now made to Fig. 3, which is a flow 

10 diagram illustrating a method of obtaining egress from a 
layer-2 subnet into a layer-3 network at different exit points 
in accordance with a disclosed embodiment of the invention. 
This method may be carried out simultaneously and in conjunc- 
tion with the method of Fig. 2. The process steps that follow 

15 are shown with reference to a single RPR node. However, all RPR 
nodes in a ring normally execute the process steps shown below 
independently and concurrently. 

[0079] At initial step 46, a RPR node of the RPR subnet 

examines its OSPF routing table and selects groups consisting 

2 0 of at least two table entries. Each entry of a given group cor- 
responds to a specific destination network, and involves more 
than one next hop to the destination network. This and the 
steps that follow apply not only to OSPF, but also to other 
routing protocols that support equal multi-path routing tables. 

25 Again, as in the flow chart presented in Fig. 2, the process 
shown in Fig. 3 is performed simultaneously for all RPR nodes. 
For example, in Fig. 1, each RPR node would have three entries 
in its OSPF routing table to a specific destination network, 
assuming that the cost from each exit point (the RPR nodes 14, 

30 16, 22) to the specific destination network is equal. 
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[0080] Next, at step 48, the RPR node updates its rout- 

ing table. Entries (corresponding to routes) that were selected 
in initial step 46, are cost adjusted in accordance with Equa- 
tion 1 and Equation 2. 

[0081] Next, at step 50, the routes adjusted in step 48 

are analyzed by the RPR node . 

[0082] Next, at final step 52 an optimum path from the 

RPR node to an external node via an exit point of the RPR sub- 
net is chosen. The metric enables the nodes of the ring to 
choose the best egress node for each external address. This is 
done in the same manner as in final step 34 (Fig. 2) . The de- 
tails are not repeated in the interest of brevity. Thereupon 
the procedure ends . 

[0083] It will be appreciated by persons skilled in the 

art that the present invention is not limited to what has been 
particularly shown and described hereinabove. Rather, the scope 
of the present invention includes both combinations and sub- 
combinations of the various features described hereinabove, as 
well as variations and modifications thereof that are not in 
the prior art, which would occur to persons skilled in the art 
upon reading the foregoing description. 



